Skip to content

Aligning muon alignment code - #51083

Open
kandrosov wants to merge 1 commit into
cms-sw:masterfrom
kandrosov:MuonAlignment_CMSSW_17_0_X
Open

Aligning muon alignment code#51083
kandrosov wants to merge 1 commit into
cms-sw:masterfrom
kandrosov:MuonAlignment_CMSSW_17_0_X

Conversation

@kandrosov

Copy link
Copy Markdown
Contributor

PR description:

The muon alignment code was diverged from the central CMSSW. In fact, all muon alignments for Run 3 were produced using private forks. The goal of this PR is to rebase modifications made over the past few years onto the current CMSSW. In this PR, we would like to keep the code as close as possible to what was used for Run 3 alignments to provide a reference point. Once it is merged, we plan to refactor/modernize the code and introduce new developments for Phase 2.

PR validation:

Alignment results obtained with the "usual Run 3 alignment code" and this merged version of the code are compatible.

FYI @acagnotta

@cmsbuild

cmsbuild commented May 28, 2026

Copy link
Copy Markdown
Contributor

cms-bot internal usage

@cmsbuild

Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51083/49547

@cmsbuild

Copy link
Copy Markdown
Contributor

A new Pull Request was created by @kandrosov for master.

It involves the following packages:

  • Alignment/CommonAlignmentMonitor (alca)
  • Alignment/CommonAlignmentProducer (alca)
  • Alignment/MuonAlignmentAlgorithms (alca)
  • TrackingTools/TrackRefitter (reconstruction)

@Alejandro1400, @JanChyczynski, @Moanwar, @arunhep, @atpathak, @cmsbuild, @jfernan2, @mandrenguyen, @perrotta, @srimanob can you please review it and eventually sign? Thanks.
@24LopezR, @CeliaFernandez, @Fedespring, @GiacomoSguazzoni, @HuguesBrun, @VinInn, @VourMa, @abbiendi, @bellan, @cericeci, @dgulhan, @elusian, @felicepantaleo, @fsimone91, @gpetruc, @jhgoh, @llunerti, @mmasciov, @mmusich, @mtosi, @pakhotin, @rovere, @rsreds, @tlampen, @tocheng, @trocino, @yuanchao this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@perrotta

Copy link
Copy Markdown
Contributor

please test

@perrotta

perrotta commented May 28, 2026

Copy link
Copy Markdown
Contributor

Alignment results obtained with the "usual Run 3 alignment code" and this merged version of the code are compatible.

@kandrosov please provide evidence for it, in particular about what do you mean by "compatible". Did you present the comparison somewhere (e.g. Muon or Tracking POG, CondPrep meetings)?

@cmsbuild

Copy link
Copy Markdown
Contributor

-1

Failed Tests: HeaderConsistency UnitTests RelVals RelVals-INPUT AddOn
Size: This PR adds an extra 132KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd7c7b/53541/summary.html
COMMIT: 4ef6830
CMSSW: CMSSW_17_0_X_2026-05-28-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/51083/53541/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 2 errors in the following unit tests:

---> test test_MC_23_crosscheck had ERRORS
---> test test_MC_22_crosscheck had ERRORS

Failed RelVals

----- Begin Fatal Exception 28-May-2026 16:36:16 CEST-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=GlobalMuonProducer label='globalMuons'
Exception Message:
MissingParameter: Parameter 'RefitMuonHits' not found.
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 28-May-2026 16:41:00 CEST-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=TrackingRecoMaterialAnalyser label='materialDumperAnalyzer'
Exception Message:
MissingParameter: Parameter 'RefitMuonHits' not found.
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 28-May-2026 16:39:29 CEST-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=TrackingRecoMaterialAnalyser label='materialDumperAnalyzer'
Exception Message:
MissingParameter: Parameter 'RefitMuonHits' not found.
----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

Failed RelVals-INPUT

  • 138.5138.5_ExpressCollisions2021/step2_ExpressCollisions2021.log
  • 138.4138.4_PromptCollisions2021/step2_PromptCollisions2021.log
  • 138.2138.2_ExpressCosmics2021/step2_ExpressCosmics2021.log
Expand to see more relval errors ...

Failed AddOn Tests

----- Begin Fatal Exception 28-May-2026 16:32:36 CEST-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=GlobalMuonProducer label='globalMuons'
Exception Message:
MissingParameter: Parameter 'RefitMuonHits' not found.
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 28-May-2026 16:32:37 CEST-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=GlobalMuonProducer label='globalMuons'
Exception Message:
MissingParameter: Parameter 'RefitMuonHits' not found.
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 28-May-2026 16:32:41 CEST-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=GlobalMuonProducer label='globalMuons'
Exception Message:
MissingParameter: Parameter 'RefitMuonHits' not found.
----- End Fatal Exception -------------------------------------------------
Expand to see more addon errors ...

@cmsbuild

Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51083/49559

@cmsbuild

Copy link
Copy Markdown
Contributor

Pull request #51083 was updated. @Alejandro1400, @JanChyczynski, @Moanwar, @arunhep, @atpathak, @cmsbuild, @ctarricone, @gabrielmscampos, @jfernan2, @mandrenguyen, @perrotta, @rseidita, @srimanob can you please check and sign again.

@Moanwar

Moanwar commented May 29, 2026

Copy link
Copy Markdown
Contributor

@cmsbuild please test

@perrotta

Copy link
Copy Markdown
Contributor

It remains inteded that this PR will get signed by alca only after the presentation in the CondProp meeting that you are anticipating here above

Hi @kandrosov @acagnotta are there news about the planned presentation of this updated code and its results, in a CondPrep meeting?

@cmsbuild cmsbuild modified the milestones: CMSSW_20_0_X, CMSSW_20_1_X Jun 30, 2026
@acagnotta

Copy link
Copy Markdown

It remains inteded that this PR will get signed by alca only after the presentation in the CondProp meeting that you are anticipating here above

Hi @kandrosov @acagnotta are there news about the planned presentation of this updated code and its results, in a CondPrep meeting?

Hi @perrotta, sorry for the late reply. I scheduled a contribution at Conditions Preparations meeting for today, unfortunately the meeting will be only virtual. Link to the presentation, let us know if you have any questions.

@perrotta

perrotta commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

@acagnotta @kandrosov thank you for the link to the "virtual" presentation at the CondPrep meeting of July 13.
That presentation assesses that this PR is just intended to port in central CMSSW the private fork that was used over the past few years for the Track Based Muon Alignmenmt. It is therefore not expected that the outputs of the alignment script obtained withi this PR are necessarily fully compatible with those obtained with the (outdated and non-used) code currently in CMSSW. In this respect, the presentation that you linked confirms that the output obtained with the code updates that you are submitting here do correspond to what was obtained by running the private script during the latest alignment campaigns.

This is enough for me to eventually sign this PR for AlCa. Before doiing so, could you please consider the few small improvements suggested here above? And possibly also squash all commits into a single one, for easier future tracking of the modifications applied to the code?

- Adapted code to be compatible with the latest CMSSW version
- Implemented review comments
@cmsbuild

cmsbuild commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51083/50502

@cmsbuild

cmsbuild commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Pull request #51083 was updated. @Alejandro1400, @EltonSh, @JanChyczynski, @Moanwar, @arunhep, @cmsbuild, @jfernan2, @mandrenguyen, @perrotta, @srimanob can you please check and sign again.

@perrotta

Copy link
Copy Markdown
Contributor

please test

@cmsbuild

Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests
Size: This PR adds an extra 20KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd7c7b/55277/summary.html
COMMIT: 57c6986
CMSSW: CMSSW_20_1_X_2026-08-12-1100/el9_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/51083/55277/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 1 errors in the following unit tests:

---> test test-das-selected-lumis had ERRORS

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 46
  • DQMHistoTests: Total histograms compared: 3679791
  • DQMHistoTests: Total failures: 41
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3679732
  • DQMHistoTests: Total skipped: 18
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 45 files compared)
  • Checked 199 log files, 169 edm output root files, 46 DQM output files
  • TriggerResults: no differences found

@perrotta

Copy link
Copy Markdown
Contributor

+alca

  • The Muon alignment code that is currently in the release is not the one actually used for muon alignment (using semi-private muon alignment code and tools): this PR ports in CMSSW the code in use.
  • Changes outside the private scripts are only those needed to add one extra paramenter in TrackingTools/TrackRefitter/src/TrackTransformer.cc‎
    • Default in them remains the same as before everywhere but for the MuonAlignmentFromReferenceGlobalMuonRefit, which does not enter standard reconstruction workflow, only Muon alignment ones, as far as I can tell

@mmusich

mmusich commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

@cmsbuild, please test

  • to refresh tests

@cmsbuild

Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests
Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd7c7b/55528/summary.html
COMMIT: 57c6986
CMSSW: CMSSW_20_1_X_2026-08-24-1100/el9_amd64_gcc14
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/51083/55528/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 1 errors in the following unit tests:

---> test testAlignmentStats had ERRORS

Comparison Summary

Summary:

@mmusich

mmusich commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

@cmsbuild, please test

  • now tests should finally go smoothly (?)

@cmsbuild

cmsbuild commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

+1

Size: This PR adds an extra 20KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd7c7b/55700/summary.html
COMMIT: 57c6986
CMSSW: CMSSW_20_1_X_2026-09-03-2300/el9_amd64_gcc14
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/51083/55700/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 47
  • DQMHistoTests: Total histograms compared: 3836516
  • DQMHistoTests: Total failures: 19
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3836479
  • DQMHistoTests: Total skipped: 18
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 46 files compared)
  • Checked 203 log files, 173 edm output root files, 47 DQM output files
  • TriggerResults: no differences found

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants